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(57) Abstract 



A method and apparatus for reducing storage requirements for display data on a computer system (12). Data objects (22) to be 
displayed are organized into display lists and each data object inciudes.an object type, such as text, graphic, and image. The data objects } 
(22) are rastenzed into an uncompressed band buffer and divided into non-intersecting bitmap regions each identified with one or more 
object types. Each non-empty region is assigned a compression algorithm dependent upon the type of the region and specified compression 
constramts. The regions are combined with each other into larger regions if appropriate, and each region is compressed using its assigned 1 
compression algorithm into a compressed band buffer, thus reducing the required storage space for the data objects. Hie compressed date is 
decompressed m scan line order with a selected decompression algorithm corresponding to the assigned compression algorithms to produce 
uncompressed output data. The uncompressed output data is supplied to an output display device (16) for display. 
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METHQD AND APPARATUS FOR REDUCING STORAGE 
REQUIREMENTS FOR DISPLAY DATA 

CROS S REFERENCE TO RELATED APPLICATIONS 

This application is a continuation-in-part of co-pending parent patent application 
07/974,204, filed November 10, 1992 on behalf of Ronald S. Gentile, entitled, 
"Method and Apparatus for Processing Data for a Visual-Output Device with 
Reduced Buffer Memory Requirements," assigned to the assignee of this present 
application, and which is incorporated by reference herein. 

BACKGROUND OF T HE INVENTION 

The present invention relates generally to the display of data by output devices, and 
more particularly to a method and apparatus for reducing memory storage 
requirements when displaying data on an output display device. 

A computer system can output data to a wide variety of output display devices. 
Output display devices such as laser printers, plotters, and other printing devices 
produce an image or Visual representation" onto a sheet of paper or the like, while 
output display devices such as computer monitors develop visual representations on 
a computer screen. 

Many output display devices receive display data in the form of a "bitmap" or "pixel 
map" and generate visual representations from the display data. A pixel is a 
fundamental picture element of a visual representation generated by a display 
device, and a bitmap is a data structure including information concerning a number 
of pixels of the representation. Bitmaps that contain more than on/off information are 
often referred to as "pixel maps." As used herein, both bitmaps and pixel maps are 
referred to as "bitmaps." 

A printer can print dots on a piece of paper corresponding to the information of a 
bitmap. Alternatively, a computer monitor can illuminate pixels based upon the 
information of the bitmap. A "raster" output device creates a visual representation 
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type of compression Fs often used with text objects and the like, since text character 
codes often include extra information unrelated to the identity of the text characters. 
Other types of compression algorithms are "lossy", meaning that they compress data 
with some loss of information. These types of compression algorithms are typically 
used with image bitmap data, since the loss of information can often be unnoticeable 
in a high resolution image. When the compressed bitmap is to be displayed, it is 
decompressed using a corresponding decompression algorithm and sent to the print 
engine, monitor, or other output display device. 

A problem with the compression method of the prior art occurs when different types 
of objects are to be displayed by an output display device. For example, a page of 
data can include text objects such as words or paragraphs, graphics objects such as 
bar charts or geometric shapes, and image objects such as a digitized photograph. 
A compression algorithm that is good for text objects may, for example, be less than 
adequate for image objects, and vice versa. For example, lossy compression 
techniques may be adequate for image objects in that they can highly compress the 
image object data, but may be less than adequate for text objects, where the lost 
data would be apparent. A lossless compression technique is good for text objects, 
but may not adequately compress image objects. Thus, the selection of a single 
compression algorithm will almost always result in a less-than-optimal compression 
of mixed object types. 

SUMMARY O F THE INVENTION 

The present invention provides a method and apparatus for storing display data with 
reduced storage requirements. The present invention compresses multiple types of 
data objects using compression mechanisms that are optimized for each type of 
object according to user constraints. The compressed objects are then 
decompressed using a related decompression mechanism and sent to the output 
display device for display. 

The apparatus of the present invention includes a digital output processing system 
with selective object compression and decompression. A rasterizer converts data 
objects into bitmap objects of various types. A compressor compresses the bitmap 
objects with a selected compression mechanism. The particular compression 
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compressed output data. The selected compression algorithm for the output data 
is dependent upon the type of the output data and meets a user's specified 
constraints for compression. The compressed output data is stored in digital 
read/write memory and is decompressed with a selected decompression algorithm 
5 to produce uncompressed output data. The decompression algorithm is chosen from 
a set of decompression algorithms and is dependent upon the compression algorithm 
used to compress the compressed data. The uncompressed output data is then 
supplied to an output display device. 

The output data is stored as objects in display lists including an object type and an 
10 object location on a page of data. The display lists correspond to multiple bands into 
which the page is organized. The objects of one of the display lists are rasterized as 
bitmap objects in an uncompressed band and stored in an uncompressed band 
buffer. The band is partitioned into non-intersecting bitmap regions, where each 
bitmap region has at least one type corresponding to the type(s) of the object(s) 
15 which the region covers, or an empty type if no object is covered. A compression 
method is assigned to each region based on the types of the regions and any user 
constraints that include the compression ratio of the compression method and visual 
quality of the data after being compressed and decompressed. Adjacent regions and 
regions which include empty regions between them, and having the same assigned 
compression method, are preferably combined into larger regions. The non-empty 
regions of the uncompressed band are then compressed and stored in a compressed 
band buffer of the digital read/write memory. This step includes checking if the 
compressed regions fit in the compressed band buffer when compressed. If the 
band doesn't fit when compressed, previously-compressed bands are decompressed 
25 and recompressed to provide more storage space for the compressed band. 
Another band of the page is then rasterized and compressed. Once all the bands 
of the page are compressed, a page of compressed data is decompressed in scan 
line order and supplied to the output device. Background display data is provided to 
the output device for portions of the page that are not included by compressed 
30 regions. 

An advantage of the present invention is that object data is compressed with 
compression mechanisms suited for each type of object included in display data. 
This allows much greater optimization of compression in that a compression 
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Figure 1 „ a btock diagram of a computer system for displaying a page having 
o^eclsofdiffenant^pesinaccordancewiMhepresentlnvenBon 
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Figure 2a is a Mod. diagram of a d W al processor as shown in Figure 2; 

Figure 3 is a , fe. diagram iliusfrating the access of displaymg oata with reduced 
storage requirements according to the present invention; 

i7d 4 rrTr ram *• m *** - 

input data step of Figure 3; 

Hgure 4b is a flow diagram H.ustrating the second portion of the rasterize and 
compress input data step of Figure 3; 

25 mput data step of Figure 3; compress 
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Figure 4d is a diagrammatic illustration of a page of objects, the page being divided 
into bands; 

Figure 4e is a diagrammatic illustration of a band including objects; 

Figure 4f is a diagrammatic illustration of the band of objects of Figure 4e that has 
5 been partitioned into non-intersecting regions; 

Figure 5 is a flow diagram illustrating a step of Figure 4a in which input object type 
and bounding box information is stored in collectors associated with bands; 

Figure 6 is a flow diagram illustrating a step of Figure 5 in which like objects in a 
collector are joined; 

1 0 Figure 7 is a flow diagram illustrating a step of Figure 5 in which object combinations 

in a collector are forced to free storage; 

Figure 8 is a flow diagram illustrating a step of Figure 4b in which a band is 
compressed; 

Figure 8a is a table of algorithm entries referenced by the process of Figure 8 to 
15 assign algorithms to regions; 

Figure 8b is a table of indexes into the algorithm table of Figure 8a for assigning 
algorithms to regions; 

Figure 9 is a flow diagram illustrating a step of Figure 8 in which non-intersecting 
rectangular regions are designated in the band to be compressed; 
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Figure 9a is a diagrammatic illustration of a data structure describing a region of 
Figure 9; 

Figure 10 is a flow diagram illustrating a step of Figure 8 in which eligible regions are 
combined; 
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Figure 11 is a flow diagram illustrating steps of Figure 10 in which regions 
combined; 
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attempted to be compressed; 

Figure 13 is a flow diagram iltusuating a step of Figure 3 in which 
data is decompressed and displayed; and 

5 Figure 13a is a diagrammabc i»us«ra«o„ a, a band and the scanning * te tand t0 
decompress data. 
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communications bus T4, a pnnter 16, a display 18,. or other output display device 20. 
The output of devices 1.6, 18, or 20 is a visual representation on a displayed page 22. 
Digital computers 12 can be personal computers (such as an IBM-PC AT-compatible 
or Apple Macintosh personal computer), workstations (such as a SUN or Hewlett- 
5 Packard workstation), etc. Computers 12 typically each include a microprocessor, 

a memory bus, random access memory (RAM), read only memory (ROM), 
peripherals such as input devices (keyboard, pointing device, voice recognizer, etc.), 
and storage devices (floppy disk drive, hard disk drive, etc.). In an alternate 
embodiment of the present invention, display data can be sent to other memory 
devices or storage devices instead of being sent to output display devices. 



Printer device 16 is an output display device that can produce a printed visual 
representation of a displayed page 22 on a piece of paper, a transparency, etc. In 
the present embodiment, printer device 16 is a raster device which creates the visual 
representation with a plurality of printed dots arranged in rows and columns 
15 corresponding to a bitmap. That is, a bitmap can be input to the printer device 16 
and the bits of the bitmap can be displayed as pixels. Alternatively, higher-level 
objects can be sent to the printer 16, and the printer can perform the rasterization 
process. 



20 



Display 18 is an output display device that displays visual representations on a 
screen. Display 18 can include a cathode ray tube (CRT), which is typically operated 
as a raster device. Other types of displays include LCD screens, electroluminescent 
displays, etc. 

Other output display device 20 is any other form of device used to display a visual 
representation, in either a temporary or permanent form. Other output display 
25 devices include projection devices, plotters, etc. 

To display visual representations on an output display device, such as printer device 
16, display 18, or other output device 20, one or more types of procedures can be 
implemented. One procedure is to input data objects, and then rasterize bitmaps 
from the objects. For example, the object of a text character can include associated 
30 information which specify how the character is to be displayed, such as positional 

coordinates, size, font, etc. 
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A well known pane descritfon ianguage' for specking object and reiafcd 
^a^thaPoaSc^nguag, by Adobe Systems, inc. „f Mounts 
Calrfoma. Theobjec.can,,orexamp,e, Mode a bitmap describing a text d-M." 
or the object can reference or poin, «o stored character out»nes which deecribe the 
shape of a charade, and inctudes other reprizing mfermarion. such as (ont and 
. A we,*,ow„ tractor outtine forma. Is the Type 1« forma,, by ^ 
Sys.ems.mc.lnaddlBon.obiecfssuch as graphics, shapes canbe stored as graphic 
pnmri,ve, which are basic shape ob)ecfs used fo fona more compiex graphics, 
shapes. Fram fhe objects, the con.pu.er 12 or output devfce ,S. ,8 J 20 can 
astern a M map and e«,er send the biunap fo a memo,, cache or ofher storage 
area that ,s accessible for display or store the bitmap for fater use. 

The process of the present invention, as descnbed below, provides a technique for 
manipulating bilmaps derived from objects so ma, leas storage space is Quired 

r PDL «,e ,s a «,e or similar storage una which Wudes objects^ in pie 
deacon ianguage such as PoetScnp, or Portabfe Document Forma,™ (PDF™, 
by Adobe Systems. 1 ' 

Dfcpiayed page 22 indudes visua, representations preduced by one of me oulpu, 
deploy dev.ces , 6 , 18 , and 20 . H>Iein , ^ rf ^ ^ 

or group o, visual represents tha, can be viewed by me user aa a una. For 
example, a page o, dfcptayed representations from a printer device 16 can be the 
represents shown on a singfe sheet of paper ,or more sheefe, 
de«ned ,p span mu^e sheets o, paper,. On a diaptay screen 18. a page can 
compnse the representations shown a, one time on me screen, or can comprise a 
^-J^nsofwh^o^yapomon^^^^^,^ 
tmerpretera such aa the PosScdp, in.erp.ter, . page of data „ 

~^ a " SenUOan °^ ,di ^^^---e i s 

tn the described emb^dimant. disced page 22 incudes severe, different types o, 

w"TT" "^"'•^•^-"—^ionsaremesam! ^ 
types of ,he data objects from which the representations are derived In ,h 
descnbed embodimen,. three types o, dare objects are addressed: tex, ob^s 



PCIYUS96/09856 
// 

graphics objects, and image objects. Other types of objects can also be defined and 
processed in alternate embodiments of the present invention. In the present 
embodiment of the invention, the type of an object can be defined by the commands, 
data, and operations used to display the object and the object's ability to be 
compressed/decompressed more efficiently and with less loss of quality using 
particular compression algorithms as opposed to other algorithms. For example, 
specific types of data (character codes), procedures, character outlines, etc. are 
used to describe a text object, which is known to compress more efficiently using 
particular algorithms. Thus, the type "text" is defined in view of these factors. Object 
types can be defined in other embodiments based on, for example, the final 
appearance of the displayed object, the resolution of the object as displayed, or other 
criteria. 

Text representation T is derived from a bitmap that, for example, was rasterized from 
text objects. For example, a character code in a text file can used to index a 
character drawing procedure which defines a text object, as is well known to those 
skilled in the art. Graphics representation G is derived from a bitmap that was 
rasterized from coded graphics objects, such as trapezoids and lines. These 
primitive graphics objects can be sized and shaped to describe the graphics object. 
Image representation I is typically not derived from any coded objects, since its 
original form is a bitmap, also referred to as an object. Scanned images, digitized 
photographs, etc., are data objects of the image type which are in bitmap form and 
can usually be displayed by an output display device directly or with a transformation 
of coordinates. 

Visual representations T, G, and I may all be displayed, and even overlap each 
other, on a single page of displayed data. These types of objects are each 
compressed into a band buffer using an optimized compression algorithm for each 
type of object, as described below in greater detail. 

Figure 2 is a block diagram of an output display device which, as an example, will be 
described as printer device 16. Printer device 16 preferably includes a buffer 24, a 
digital processor 26, RAM 28, ROM 30, I/O interface 32, and print engine 34. Buffer 
24 is a memory buffer used to buffer data received from computer 12. Printer device 
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print engine of a laser printer, as is well known to those skilled in the art, typically 
includes such components as a toner mechanism for applying a visual representation 
to a piece of paper, feeding mechanisms, and other components required to produce 
a displayed page. If an output device such as a display screen is being used, the 
print engine can be a CRT or other actual screen which displays visual 
representations derived from the bitmap. Alternatively, output bitmap data can be 
sent directly to print engine 34 from processor 26 via direct line 31. 

The components shown in printing device 16 in Figure 2 can alternatively be included 
in computer 12 rather than print device 16 or any other output display device. For 
example, the digital processor 26, RAM 28, ROM 30, and I/O 32 can be included in 
computer 12 and can provide output bitmaps to print engine 34 located in the output 
display device. RAM 28, used to store compressed data, can be associated with the 
actual output display device that displays the visual representation and be located 
external to the output display device. 

The compression of displayed data, as described below, is implemented by digital 
processor 26 and can be accomplished on computer 12; the decompression of this 
data can then be implemented on an output device 16, 18, or 20. However, in such 
an embodiment, standard compression algorithms would preferably be used by 
computer 12 so that an output device could readily decompress data from any 
computer sending it data (or a description of the used compression algorithm would 
be sent with the compressed data so that the output device could understand the 
compression algorithm and decompress the data). If all compression and 
decompression takes place in the output device, as shown in Figure 2, standard or 
non-standard compression algorithms can be used. 

In an alternate embodiment, computer 12 can send compressed data to a storage 
device (not shown), such as a hard disk drive, floppy disk, PCMCIA card, magnetic 
tape, etc., for storage prior to displaying the data. 



Figure 2a is a block diagram of digital processor 26 shown in Figure 2. In the 
described embodiment, processor 26 includes a CPU 36 and an application specific 
integrated circuit (ASIC) 38. The CPU is preferably a general purpose 
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rn.croprocessorv.hi* controls the operation of printer device 16. CPU 12 can be a 
angle-chip processor or can be implemented with mulbple components. 

in the described embodiment, AS!C 38 is an integrated circuit des lgned t0 fmlm 
the compression and decompression operations. AStC 38 uses compression 
algorithms that are preferably implemented in hardware i„ me ASIC The 
compression atgorithms are seiecteo by sottware routines impiemented by CPU 36 
to compress bfcnaps so tha. the bitmap wll require tess space to be storad AStC 
38 also uses decompression aigorithms for decompressing me compressed bitmaps 
back to Mr original s*e and torn, using parameters specifed in me compressed 
date in other embodiment, compression and decompression can be petfomrad by 
software or by omer hardwara component in me computer system. A RAM 3 9 can 
also be implemented locally to ASIC 38 to stora strectures and date used during 
compression and decompression. 

Many compression/decompression algorithms are known to those skilled m the art 

aToriT 7 T* ^ ^ — — 

algorithms ,o ach,e»e a more efficient raduction in required storage apace for a 

b»m.p that is fo be displayed with minima, toss of disptay quality, as described 
below. 

Figure 3 is a flow digram illustraing me prccess 40 o, displaying date with reduced 

storage requirements according to the present invent, The process begins at 42 

in step44. a single page's content of input data is rasterized and composed based 

upon tasterized object types. Step 44 enteits several individual steps, including 
orea ng d isplay , isls „ ^ ^ ^ ^ ^ J 

d,s P la» bate into bitmap objects in bands, compressing the bands accenting to the 
^pesofobiactetocated in me bands, and storingthe compressed bands in memo™. 
Tha process is described m greater detail „«h respect to Figures 4a, 4b. and 4c By 
compressing the rasterized date, the amount of memory required to store the data 
can be significantly reduced. 

in step 46, the digito, processor decompresses the compressed bands that have 
been stored in memo* and sends ate decompressed date, one band a, a „me, to 
.he d,sp,ay engme. This is accomplished using decompression algorchms and 
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information stored in each compressed band. Data in a band is sent directly to the 
display engine to be displayed as soon as it has been decompressed. The page has 
been completely displayed when all compressed bands have been displayed. In an 
alternate embodiment of the present invention, the compressed band is 
decompressed and stored in a different memory or storage area for multiple uses, 
including display. The process of decompressing and displaying the bands of data 
is described in greater detail with respect to Figure 13. In next step 48, it is 
determined whether another page of data is to be displayed. If so, the process 
returns to step 44 to rasterize, compress, decompress, and display the next page's 
worth of data in steps 44 and 46. If there are no more pages to display, then the 
process is complete as indicated at 49. 

Preferably, a page of data can be compressed simultaneously with the display of a 
previous page in a document or other group of pages. For example, as data from 
the first page is still being decompressed or displayed in step 46, the second page 
in the document can be rasterized and compressed in step 44 simultaneously. 
Similarly, multiple pages can be decompressed simultaneously. For example, 
multiple tandem decompression engines can decompress multiple pages wherein 
each decompression engine decompresses and displays a certain color or shade on 
a side of a page. Each page can be passed through the pipeline of decompression 
engines, where each decompression engine receives the next page in the pipeline 
when it finishes with its current page. Such a process can also be used with the 
compression and rasterization of the present invention. In an alternate embodiment, 
instead of compressing, decompressing and displaying output display data on a 
page-by-page basis, each "band" or other portion of a page can be sequentially 
compressed, decompressed and displayed. 

Figure 4a is a flow diagram illustrating a first portion of the rasterize and compress 
input data step 44 of Figure 3. The process begins at 52 and implements three 
initialization steps 54, 56, and 58. In step 54, the compression level used for 
compressing data in the present invention is set to the lowest available level. The 
compression "level" determines the compression ratio for compressing data, where 
a lower level typically corresponds to a lower compression ratio (i.e., a lower amount 
of compression) as described herein. In next step 56, all bands on the current page 
are represented as a compressed form of whitespace. Whitespace (or "background" 
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date) »*» to white 6, unmarked areae of a page ma, do no, include any objec, dato 

A ^ ls P»^into.number of bands 
each band is ana^ed and compressed separate,,. An example o, bands 112 o, a 
page 110 are show, ,n Fig ure 4d and are described in further detoil below The 
compressed whteapace dato is stored in toe compressed band buffer, as descnbed 
betow. in stop 58. an emp,y cobclor is created and iniUafeed tor each band 1 12 o, 
ate curren, page 1 10 so ma, every band has an associated ooilector. A "collector 
as referred to herein, is a dato sbw^ or other storage area and/or aasodatod 
rnsbuchons M store dato associated wim ma, cCtoctors assoda,ed band Data 
stored „ me coltector is used to compress objects included in ft. associated band 
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In next step 60. the process determines whemer t, end o, me page has been 
"ached, i.e. whemer a,, input dato for, he page hasten added to dismay listo The 
end of me page can be detected, for examp te . by re « Mng an 
»mmand or indicator from the page desohpaon ,anguage «le. „ | is no, me end of 
.he page, ,hen step 62 is implemented, in which me process checks whether f, 
dsplay as, storage is exhausted. Inpu, objecto are stored in dfeplay Hate, which are 
portions of avatable memory, such as RAM 28 and/or additional memory This 

TTr TT be °° me ** **" a " ^ *** °* a « — * 
d,sptoy «a. „ mis cecum, m. mpu, ob^ds in a setoctod band's display «a, are 

mym, raatehzed and m, band is compressed. wNch a,,ows those inpu, ob|a«s 
to be mmoved ,or wrtden over) in the display list This frees space in ,he dispjay lis, 
to . ore addisonal mpu, objecto. This precede ia kn^wn as -cycang". . ta portions 
of the compression method of toe presen, invention are cyded to free apace in a 
asptoy«s,. Atandmaybecom^asedhavrngonlyaporaonofito^o^ectoand 
toen decompressed to allow addtoa, inpu, objecto to be added (rasterized) Wo me 

ton TTT^ ' f 0.*— pmcessconffnues 
to node 71 o, Rgure 4b to comp^ toe (possibly incomplete) band, as detefed 
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PostScript language or in a different page description language as part of a page 
description file. In the described embodiment, the input object generally is an "object 
primitive" or "graphic primitive," which is a basic graphical object that has an object 
type. For example, the object can be a character or a word bitmap or code having 
5 a text type. The object can also be a trapezoid, line, or other primitive shape from 

which other, more complex, shapes are constructed; such a shape can be 
considered to have a graphics type. The object could also have an image type, i.e. 
the object can be an image segment bitmap having pixels of defined location and 
color, if appropriate. In general, herein, "object" refers to the type, bounding box, 
1 0 and description data of an input object, and can refer to objects in bitmap form or in 
non-bitmap form. 



In step 66, the type and the bounding box (size and location) of the input object are 
stored in the appropriate collectors for the bands spanned by the object. The type 
of the object is one of several types that have been previously defined. For example, 
text, graphics and image types are described herein; additional types can also be 
provided. The type of an object can be determined from the input data describing 
the object. For example, if the input object has been specified in language such as 
PostScript, the type of an input object is evident from the commands of the 
PostScript file. PostScript can specify the type of a object in the context of the 
commands pertaining to the object, and a PostScript interpreter can be used to 
identify this type. For example, a SHOW (X) command is known to display text 
characters, so the object X is known to be of text type. When the input object was 
originally output by, for instance, a word processor, spreadsheet, or other PostScript- 
generating program, these commands were created in the PostScript file. If the input 
object was originally output by a graphics object type editor or drawing program such 
as Adobe Illustrator®, graphics-type commands (MOVETO, LINETO, FILL, etc.) 
inform the PostScript interpreter that the data has a graphics type. If the object was 
originally output from an image bitmap editor or program such as Adobe 
PhotoShop™, then the data can be identified from image type commands in the file, 
as is well-known to those skilled in the art. A PostScript interpreter can handle all of 
the other commands and information in a PDL file, and provide just the input objects 
to the present process in step 64. 
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The location and size of toe object is adored h co,,e« OI s. ,„ the destaed 

A tart. box is a tecfcngie or otoer pa^ whose sldes are . 
«*ta toe ed.es toe object so toa, toe object is comply cndosed '^ 
Four se b o, x. y <e.». hodzonta,. vertica|) ^ > 

toe four come* of toe bottndin, box. Atemative)y , m ^ „ ^ 
opposde corners o f each bounding cox can be stored as the ,ooa«ion of toe £T 
Other methods can also be used to describe th* u 
corner and toe „„, and he*h, o, ^ ^ "* " **• « 

The appropdate cCecton-s, ,o store an ob^s type M ^ ta „ ^ 

toeob^spans. As shown in Figure 4o, a page HOofdaUris proferabv panned 
,n.o a number of bands 112. whi* are portions „ . 

n otoer embodiment, bands can be defned as otoer areas o, toe pa^ Ea TbTd 
. Processed and compressed seguenMy; ms aBow . sma , fer 
be processed a, one «m. so toa, toe entire page of data does no, have J ^ 
m memory. ,n toe prefened embody, toe page 110 is par,^ ^ ' 
beta o, eoua, s E e (e.g. 256 rows or scan iines fcr each band,, atthough in ole 
toe number and s*e o, bands can depend on toe pag .2 
~U» o, drspleyed represents, toe s*e of toe avatebte uncompress^ tad 
-ita etc. He,,, and . „ ^ 

r '° aSCa " " *• *■*» - «** — on an outpu, display device a 
descnbed wrth reference to Figure ,3. This dimension is show, as toe ",eZw 
dimension in Figure 4d 'Vertical- nr »v . 'en right 

M Vertlcal or Y coordinate" correspondinqlv refers to tho 

A number 0 , objeas are shown displayed on page 1,0. Boto toe M ». 
bota,ng box ofeach objec, iss tore d ,„ toe approve co„e«ors. Mha 
a ..x, ,ype and has a overal, bounding box ,20. Objec, ,16 * a grapn J ob ^ 
navng a graphics ,ype and has an overs,, bounding box ,22. o jec, m ^ 
■mage ob,ec, havin, an ima* type and an overs, bounding box ,2 
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For an object that spans only one band, the overall bounding box of the object is 
stored in the associated collector of the band. However, an input object can span 
more than one band as well. For example, text object 1 14 spans bands 1 13, 1 15, 
and 117; graphical object 116 spans bands 115, 1 17, and 119; and image object 118 
spans bands 121, 123, and 125. In these cases, a "clipped" portion of the overall 
bounding box of the object is stored in a band's collector, where the stored bounding 
box is the intersection of the overall bounding box with the band. That is, objects 
which overlap multiple bands are preferably divided into multiple objects that each 
fit in one band and collector. For example, text object 114 is clipped such that only 
the coordinates of a bounding box in band 113 for object 114 are stored in the 
collector of band 113. Text object 114 is clipped again so that only the coordinates 
of text object 1 14 within band 1 1 5 are stored in the collector for band 1 1 5, and so on. 
Methods for clipping objects are well known to those skilled in the art. Alternatively, 
clipping can be performed at a later stage in the process before or during 
rasterization step 78 of Figure 4b. 

After the type and bounding box of the objects) have been stored in the appropriate 
collectors), step 68 is implemented. In step 68, the input object is added to the 
appropriate display lists. For each band 1 12, an associated display list is created (or 
was previously created), and the current input object is added to the appropriate 
display list or lists, i.e., the data describing the appearance and content of the object 
is added to the appropriate display list. If an object overlaps more than one band, 
just the object data included in a band is stored in the display list associated with that 
band by a clipping process. Alternatively, all of the object's descriptive data is stored 
in each display list associated with overlapped bands, and the object can be "clipped" 
before or during the rasterization step 78 of Figure 4b. Thus, all of the object data 
on the page is grouped into the appropriate bands. This is desirable for data that is 
stored in a page description language such as PostScript, since the data of such a 
page description language is typically not stored in display order. The location 
(coordinates) of each object, known from the description in the page description file, 
determines the appropriate display list(s) on the page for that object. As input data 
is received, each object is placed in its appropriate display list, possibly grouped with 
other objects displayed in the same bands and thus stored in the same display lists. 
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In an alternate embodiment display Bsts do not haue to ^ ^ |n § 

ITT I?" 396 where da,a b s,ored and ,n sorted — . •» — 

can be directty o^nfeed into bands and rasterized as deschbad belo». 

; ™ 68 ' "T"" re ' ums to * me process «*— 

r n " ieend ° Mhepa9eisreached ' step7oisi ~ed. 

*e p^ess obecfc whaber a,, dismay is b are empty. , ^ ^ 
« no ob,aas were found ,o ba dspiayed on the outran, pa ge and .bus no ob^ots 



71 a,ram *" C °" ,inUeE ^ ^ 44 * *°™ nctfe 

"•27 t ^ nUeSto ^ ra ^«^^-A" 1 asa^^ has 
d slay Veneres. Pretaably. bands am sa,e«ad in diaplay .order, u tbaordar 
1 = M an output devioe diapiays d» bands. .ypioaily sterung from the top ^ £ 
doing 10 .be b* * page. „ a band bas no *p,ay « entees, ■ is s«Z 
n a„ all emate embodiment. ,be d,sp, ay bts oan be ret rieved in reverse dis^y 

17a,' tb T, ^ ** *• ^ * « "P- «ce 

o »a, me d,sp,ay lBt a, tba boltem of 1h. soreen would ba retbeved fi rat, ,o„ewed 

ylhe ne»bo«ommos« dismay ,w i„ the « iteraBon . etc , Reverse disp 
oTa^ ■ ^^^'"^^-^P^abonenoupb 

a«e. The iooabon „ tba oompresaad band buffer and state o, are data tie 
oppressed" or -no, compressed, ,o, tbe outran, band oan ba ret neved ll a 
.and reoortr. for axampie. ,ba, atoms st*h information for eaob band 

- - a compressed slate h to0 clrcwnstan(ss Band ^ * 
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band, in which only the whitespace "background" data for the band was compressed 
in step 56 of Figure 4a. This whitespace data is in a compressed state stored in the 
compressed band buffer. Band A can also have been previously compressed in a 
"cycling" loop. If the display list storage was exhausted in step 62 of Figure 4a, then 
band A may have been previously selected and compressed. If so, it may already 
stored as compressed data in the compressed band buffer including some input 
objects and must be decompressed (in step 76) to add (rasterize) any additional 
input objects to the band. 



If the band A data is in a compressed state, then step 75 is implemented, in which 
1 0 the process checks whether there is an available section of the uncompressed band 
buffer to store the current band. As described below, the uncompressed band buffer 
is used to store an uncompressed band. If it is currently full from storing one or more 
other bands, then the process continues to step 77, in which band A (the current 
band) is set to a band that currently occupies a section of the uncompressed band 
1 5 buffer. The process then continues to node 97 to compress that band by the process 

of the present invention to free the uncompressed band buffer. This process is 
described below. Once that band is compressed, the uncompressed band buffer is 
available, and the process returns to step 72 (as described below) to again select the 
original band A (or, alternatively, another band). 

20 If there is a storage section of the uncompressed band available in step 75, then the 

process continues to step 76, in which the band A data (in the compressed band 
buffer) is decompressed into a storage section of the uncompressed band buffer 
using a decompression algorithm corresponding to the algorithm used to compress 
: the data. Decompression is described in greater detail below with reference to 

25 Figure 12. 

The uncompressed band buffer is a memory storage preferably included in RAM 28 
that can store at least one band of uncompressed data. In the preferred 
embodiment, the uncompressed band buffer can store two or more bands' worth of 
uncompressed data. Each portion of the uncompressed band buffer that can store 
30 a band's worth of data is referred to as a "storage section" of the uncompressed 
band buffer. For example, the current band A is preferably stored in a first storage 
section of the uncompressed band buffer. The current uncompressed band is later 
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(that Save region is cdnsidered diagonally opgate to (he master). The region to the 
ngh. is ttre slave region and has an X-index and a Y-index of tee master region 
Since one slave indudes one (ocatton (coordinates, of the master, and one master 
.nctedes the location (coordinates) of me opposite slave, he entire area of the 
! oombined region is Known. Note one,, in other embodiments, other methods o, 
combining regions can be used. 

Figure 12 is a flow diagram illustrating step « of Rgure 8, in which tee band is 
attempted to be compressed into the compressed band butter accord!,* t0 the 
assignedalgontemsinteeband. The compression can be implemented by ASIC 38 
^rna,,ve,,byasott„areprocess. The pocessstertsa^. and,nstep 2 7 6 ' 
tee attnbu.es for a selected non-empty region in the band are read from the data 
sttuoture 22, in the region bu.ec. The ..attttbu^ for a region i„, udc rete ^ 
mferma on stored in me region* date structure used for compressing tee region 
This includes tee ktenttf.ca.on of tee contpre^on algorithm assigned te tee re*o„ 
tatata, of tee region in tee uncompressed band buffer, the size oftee region tee 
wxtth o, a scan (tee. pixel depte (number o, b*s in a pixel,, etc. In tee descnbed 
e-^ment. tee M region date steucture in a scan line order of data structures is 
M reteeved from tee .egien buffer and its associated region compressed, followed 
bythenextmg.onmscnlineorder. The scan „ne order is tee raster disptey order 
» a scan tae pointer dismays pixels on an cotput display device, as descnbed 
below m Rgures ,3 end ,3a. The scan line enter o, regions preferably starts w«h 
tee regiona, tee tep lett o, a band (detenmined by tee top fett corner of eaca region, 
M~d by tee next region to tee Hght, and so on in a leff-tc-dght. te.Ho.blm 
order. In addn.cn. tee region date stercteree do no. have «o acteal* be stored in tee 
res.cn buffer in tee scan order; teey can. for instanoe. be linked in tee scan line 
Ortter wtth (inked lists, as is we,, known te those skilled in tee art. Regions can be 
retneved and compressed in other orders in alternate embodiments. 

I" step 277. a "region descnpter' record is created for tee region sefected in step 276 

I 5 T* T '"**■«'-* ™- in tee compressed band 
buffer (some information i„ tee region „ addM ^ 

eg,on ,n step 278, The region descnptor may be Knked vate other 4on 
descriptors for Cher regions in tee band, preferably in raster display order The 
region descriptors can be used in the compression and decompression processes 
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for example, by ASIC 38. Each region descriptor preferably includes the height H (in 
pixels) and width W (in pixels) of the associated region, the location (e.g., 
coordinates) of the region on the page, pointer to the starting location of the region 
in the uncompressed band buffer such as a byte offset (used when compressing), 
pointers to the location of the region in the compressed band buffer, such as a byte 
offset from the beginning of the band (stored after compressing the region and used 
when decompressing), pointers to the compression algorithm(s) used to compress 
the region, and general parameters such as pixel depth and number of pixels on a 
scan line for the region. This information can be determined from the attributes 
retrieved from the region data structure 221 and other system parameters. In other 
embodiments, the region descriptors can be stored in other areas besides the 
compressed band buffer, or can be created before the actual compression process. 

In step 278, the "compressor" (i.e., a processor and/or any related software 
implementing the appropriate compression algorithm) attempts to compress a non- 
empty region in the uncompressed band buffer using attributes from the region 
descriptor. The compressor attempts to compress the data for the current region 
from the uncompressed band buffer using the assigned compression algorithm and 
stores the compressed data in the compressed band buffer. 

This compressed data may or may not fit in compressed band buffer, as described 
above with reference to Figure 4b. If the compression is not successful, i.e., the 
compressed data overflows the available storage space, the process is complete at 
282. If the compression is successful, then the compressed region is marked as 
"compressed" in the "band record"; also, the starting location of the band in the 
compressed band buffer and the current compression level are stored in the band 
record. Step 281 is then performed, in which the process checks if another region 
is available to be compressed. If another non-empty region is available in the region 
buffer, then the process returns to step 276 to read attributes and compress the next 
region. If another non-empty region is not available from the region buffer, then the 
process is complete as indicated at 282. 

It should be noted that only non-empty regions are compressed and stored in the 
compressed band buffer. Empty regions in the band, i.e., "background" areas or 
pixels (whitespace), are not compressed or stored, since these regions do not 
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include any object data. The present ilLon thus saves sloraS e spa ca and 
compression tana by compressing and storing only the pomona of a page inctudlng 
obtaot data. Background areas can ba displayed with the desired adributes 
(brightness, cotor, etc.) at the ft. of decompression and/or dispiay. as deachbed 
a below with respect to Figure 13. 

The present invention thus indents muHiple compression algorithms to reduce 
the storage space required by the rastenWdata white mainlining good visua, 
qua,* when dispiaying me data. These compression algorithms have bean 
opined ,o I. type of data being composed in view of severe! consbaints as 
deeded above. We**™ compraaaion aigonthms typicaiiy can compress „ 
type of object efficiently; the method of the present invention atlowa all types of 
obiec* ,o be compressed win, a much greater reduction in required storage space 
at acceptabte quaiity man , a aingte compression algorithm were used for al, object 
types* j 

Hgura 13 is a flew diagram illuatraong step 46 of Figure 3. in which the compressed 
data is deceased based upon the assigned compression algorithms and are 
decompressed dare is delayed. ,„ one embodiment, the decompression memod 
46 ,s ,mp.ementad by hardware such as ASIC 38 as shown in Fig ure 2a 
Alternatively, decompression can be implemented in software. 

The process begins at 290. In step 294, a number N of -resion descriptors- (or a 
s,m„ar list of regions) are retrieved from the banning of band(s) of dare ,„ me 
compressed band buffer for the current displayed page of dare. The region 
deecriptore are described wdh reference to Rgure ,2 and are retried in me same 
order that th * associated compressed regions are stored. The retrieved region 
daaonptore are stored in a "decompression buffer," which en be included in ASIC 
38, for example. The number N of retrieved region descriptor can way in different 
embod,mente. Preferably, N is a, leaat one more man the maximum numbar of 
regrona that can be provided on a single row or horizonte, scan tine aa daacribad 
above w»h reference to Figrae ,0. This ia desired so tha, at least one region 

^cnptorisatllmmedecompressarnbuffer whan end Cabandia reached as 
described below. ' s 



WO 96/41308 




PCT/US96/09856 



Next, the process determines the regions crossed by the next scan line in step 296. 
The first time this step is implemented, the "next' scan line is the first horizontal scan 
line at the top of the page. A "scan line", as referred to herein, is a horizontal line on 
the page that is traced from left to right (described with reference to Figure 13a). 
5 This is the typical direction of displaying pixels in raster output devices, and the data 
is typically provided to the output devices in the scan display order. Depending on 
the embodiment, scan lines can also be implemented as horizontal right-to-left lines, 
vertical, up-to-down lines, etc. Thus the terms "left", "right", "top", "horizontal", 
"vertical", etc. refer to left-to-right, top-to-bottom scan lines and may be changed 
10 appropriately in other embodiments. The next scan line is traced across the width 
of the displayed page to determine if any regions on the page are crossed by the 
current scan line. This can be accomplished by examining the height and width of 
regions and the location of regions on the page as provided in the region descriptors. 



In next step 298, the processor checks if a scan line pointer is currently within or at 
the left border of a region. The scan line pointer is the "front" of the scan line as it 
is traced across the width of the page in a displaying process. When first 
implementing these steps, the scan line pointer preferably starts at the top left comer 
of the page (the page can be oriented in any direction). The scan line pointer can 
either be within a non-empty region or within an empty region; the empty regions are 
referred to herein as "background" areas or background pixels. The background 
areas were not compressed and stored in the compressed band buffer, since there 
is no object data to store for these areas. 

If the scan line pointer is not within or at the left border of a non-empty region in step 
298, step 300 is implemented, in which background pixels on the current scan line 
are sequentially output to the display as the scan line pointer is moved left to right 
When the scan line pointer reaches the starting (left) border of a region, or the end 
of the current scan line, no more background pixels are output (until the scan line 
pointer moves to another background area). The background pixels can be 
"whitespace" pixels, such as the white background of a white sheet of paper. 
Preferably, any attribute, such as color, brightness, etc., of background pixels can 
be specified by the user for whitespace pixels. 
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After step 300. the process checks whetti the pointer is at the start of a region in 
step 2. ^^w,^.^ J 

Step 310 is then .mplemented, as described below. 

backg™* pare* i„ step 300, then step 304 is implemented, in which 
ecompress,on "state- * ret ne,ed tor the region ,ha, is cun^Uy pointed ,o Th 
decompression s«,e is informal that the "deccmpnessor- (i.e. „ proce ss 
.mpleme*. «. approprtate decompression < 

10 decision, reguirea to decompress JZZZZ 

^^^^^^^ ^ zt 

■egton deposed dato is ^caiiy peaked a, tne begi „„^ of » 6 Mmpre J 
reS ,on data ao that the deco mPres sor can immediately read the 
1= ^ontpreas the region data, in atemate ernbodtolents , ^ decom ^" si 
« be refereoced b y painters stored a, *e banning Che re gio . For exam* 
. e po lntelB can point ,o a sepa^eiy-stored tabte which lists the decent 
state forthat region. Stnuctures and data used in cornr™ ,„ eC ° mpress,on 
as*^^. , usedlncl ">'P'ess 1 on/decom pI ession such 

20 ' ' emp0rar » aate ' -nbes, ore d. fc rexa m p,e in 

ASIC 38 in alternate embodiments. 

^^304isim P W te da.,h.|^^ p ^ OT ^ ) 
rst occonence o, the re*on ,or a^ scan on the page, the decompile 

25 ir: fOTtafira,8mea " d ^ l " a ^^.^nren te d.,orexa m pn 
ASIC 38 andtor RAM 30 ,or 28). When are scan line pointer points ,o J ^ 
reoton on ^ (lower) Kan ^ „ ^ «-«- 

s rr* n hei9ht H1 and ** w - - -*» <^ - 

296descnbedabove. In next step 306, the procese decompresses the continuous 
30 ^^^.hedeconrpressionbu.eron.heourr.ucan „eandoZ T 
decomposed region data ,o be displayed. An amount o, confessed da 
^^^«*o, m e^o„,. dMan ^ trom ^^^ 
bufter. When a„ me cur.ntly.on.^us region dato on the cunen, scanTn 
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decompressed and the scan line pointer reaches the right border of the region, the 
process stops decompressing and displaying the region data. The process stores 
the location of the compressed band buffer where it stopped decompressing so that 
it will be able to start decompressing the same region data when the next scan line 
points to this region. The process preferably stores this location internally in 
registers of ASIC 38, but it can be stored in other memories as well. 

In next step 308, the process checks if the scan line pointer is at the end of the 
current scan line at the right edge of the displayed page. If not, the process returns 
to step 298, where the process checks if the scan line pointer is pointing to another 
region, and background and region data is output accordingly as described above. 
When the pointer is at the end of the scan line, the process checks in step 31 0 if any 
region(s) have been completely decompressed and displayed ("completed"). This 
can be checked, for example, by determining whether any end-of-region information 
has been retrieved from the decompression buffer. If one or more regions have 
been completed, then, in step 312, a number of new region descriptors equal to the 
amount of completed regions are retrieved from the compressed band buffer and 
stored in the decompression buffer. By continuing with the process, new region 
descriptors are eventually added in from each successive band of data on the page 
(e.g., each band^ region descriptors can be linked to the next band's region 
descriptors to effectively provide an entire page's worth of descriptors). 

Note that when the scan line pointer reaches the end of a band, then potentially 
multiple regions will have been completed, since no region extends over a band 
border. The maximum number of regions that can be completed at the end of a 
band is the maximum number of allowed horizontal regions. Thus, the maximum 
number of allowed horizontal regions can be influenced by the amount of region 
descriptors that can be loaded at one time into the decompression buffer. Since it 
requires time to load additional region descriptors from the compressed band buffer 
to the decompression buffer, it is desirable that the decompression buffer be capable 
of holding at least one more region descriptor than this maximum number so a region 
can be decompressed while new region descriptors are being loaded. 

If no regions have been completed in step 310, or after new compressed region 
descriptors have been loaded in step 312, then the process checks if the scan line 
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«*r •. a, me eod of me pa g , „ not I loess ratums to 5tep 296 , where ^ 
S T T ' ' ,ne **• 1116 — " TO * — •» P-ious 

r e ; r erabodimen,) are de, ~ » - - - * 

expressed and disced, if desired, by returning ,o the srad offhe prottss at 
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in an attemate embodiment, .he process 46 of Rgure 1 3 can be implemented on a 

step 292 .0 remove rag,on descripfors for .he nex, band. ,„ a dffl e rent 
em od,men.. an output d,sp,a y de.ce ma y no, need ,o output data ln a 
order. The compressed region dafc can be proved ,o ft. output davice in ot J 
ways for such an embodiment. evice in other 

The above-descnbet, M to ^ „ umbar of regions ^ 

smgte scan „ne can be dependent on the decompression process Per j£ 

•nce a sing te scan S „e may Wersec, many ragtons. separa. memory spaceTe^s 
* be alto ca ted to store the depression state o, each region. JJL, ~ 
compassed band butter whera deoomp.ssion ten on for eac, region, and the s*e 
of each region on the scan „ne (and any iinKs to foxing reglons , „ a llnked * ~ 

esons ,s be,„g impfcmented). Memory spece is al so required for me 
decompress™ buffer ^ memory „ AS|C 

regton information for on, a timfcd number of regions can be sLd ZTZ 
storage requirements when decompressing. 

memo a " ern Hr mb ° d " ne " t ^ ^ 66 «■ «orad to 

-mo^orad^entsto^edevteemsteadotbei^dtsptayed. Porexampte the 
d u o, . ^ ran te MmpreMed ^ . me 

a^ms o, me present i„ven,on and storad in a redely smaii memo, Z 
A. a tater „me, a targ „ slorage area may ^ ^ 

compressed data can be decompressed ,„ ,ha, memtxy instead o, to an ^ 

used a necessa*. without the disptaying steps. However, in me preferred 

embodtmentdataispreterablydecompressedton-p . 

r impressed to memoty on a per band basis rather 
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than a per page basis, and no scan line or scan line order is used. Each region can 
be entirely decompressed at a time to memory, and the decompression state does 
not have to be continually saved and retrieved each time a scan line intersects the 
region (as in, for example, steps 76 or 100 of Figures 4b and 4c). Likewise, the 
decompression of a particular region does not have to be continually interrupted 
depending on the path of a scan line. In addition, multiple decompression processes 
can be implemented simultaneously in the decompress-to-memory embodiment, 
since no sequential scan line display constraints apply. 

Figure 13a is a diagrammatic illustration of the process of decompressing a band as 
described in Figure 13. A band 320 of data includes two bitmap regions, 322 and 
324. When displayed, these regions are positioned on a background area 326. A 
scan line 328 starts at the left edge of the band and background pixels are output 
until the left border 330 of region 322 is reached. The decompression state stored 
at the beginning of region 322 is read by the process from the decompression buffer 
and the state is stored in the state buffer. The size of the height H1 of the region is 
pixels is then read from the associated region descriptor so that the process will 
know when the decompression for the region is complete. The width W1 of the 
region in pixels is also read and this amount of region data in the compressed band 
buffer is decompressed and output. This moves the scan line pointer to the right 
edge of region 322, and the location in the decompression buffer where the 
decompression left off is stored, for example, in RAM 39 or ASIC 38 (this location 
can also be stored in RAM 28 or another storage location). The process then 
outputs more background data until the scan line pointer moves to the left border 332 
of region 324. Since this is at the beginning of region 324 (i.e., the first time the data 
of the region has been pointed to by the scan line pointer), the decompression state 
for this region is stored in a different area of the state buffer. The compressed data 
of region 324 on the current scan line is then decompressed similarly to region 322. 
Once the scan line pointer reaches the right border 334 of the band, a new scan line 
336 starts at the left border of the band just under the previous scan line. In Figure 
9a, scan line 336 is shown at an exaggerated distance under scan line 328 for clarity. , 
Background data is output until the scan line pointer for scan line 336 reaches left 
border 330 of region 322. At this point, the process reads in the decompression 
state for this region from the state buffer, the size W1 of the region, and the location 
in the compressed band buffer where the decompression for region 322 left off on 
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the previous scan Una 328. The procesfL decompresses me da«a bom the 
compressed band buffer for region 322. This process conbnues simiiariy for ail 
regions of the page. 

. While «, invenbon has been descdbed in terms „, several preferred embodiments 

,s contemplated mat a«erabo„s. modibcabons and penmutabons .hereof wi,i 

IT", TT * ^ ^ ^ ^ Wn 3 ~*« * •» and 
study of ,he drawings. For example, other .ypestfobjec* besides text graphs 
and .mages csn be deflned and assigned .heir own types of compression a,o»ms 
that effiaenby compos dtos, types. In edd«on. other page descnpbon languages 
may mherently present object in a *ptay order so that the dispiay lists descdbed 
herem ana no, quired. The mappng „, objects to common algous can atso 
en,a„ severat possibles; for ,„ stance , m „ more ^ Qf 

TIT T ^ ^ a ' 90rt,hmS ' a "°' ""-»**• ««• 0^ more 
algonthms can be assKjned ,o many possible types of objecte. The consul o, the 

user uthmatety determine me compression aWhms used, and these constraints 

can include time .o compreee/decompress or display the data: storage space 

availaUe for me diapla, iists, uncom„essed band buffer, compressed band bl 

«c; me quality of me resulting displayed visual representation that is derived from 

L. r^ and , ° lhe ' SU ° h 33 °"" ™ ° h °~ 

hardware/software limitations, etc. 

Furthermore, certain terminology has been used for me purposes of deschpbve 
Canty, and no, to limit the present invenbon. „ is therefore intended ma, me 
following appended claims «.ude a» such aHerattons, modifications and 
pemtutafions as fall within the tn* spirit and scope o„he present invenbon: 

25 What is claimed is: 
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1. A system for processing data objects each representing display data for a 
display area and each having a data type and a location in the display area, 
comprising: 

a divider for dividing the data objects into a plurality of non-overlapping 
non-empty regions, where each region contains all or part of at least one data object 
and each region has a location and a region type derived from the data types of the 
data objects in the region; 

a plurality of compression mechanisms and decompression mechanisms, 
where each compression mechanism has an associated decompression mechanism; 

a compressor that selects one of the compression mechanisms for each of 
the non-empty regions according to its region type and then uses the selected 
compression mechanism to compress those portions of the data objects found in the 
region, thereby producing compressed data objects; 

a memory coupled to the compressor for storing compressed data objects; 

a decompressor coupled to the memory that decompresses compressed data 
objects to produce uncompressed data objects by applying to each compressed data 
object a decompression mechanism associated with the compression mechanism 
used to create the compressed data object; and 

a monitor coupled to the compressor, decompressor, and memory for 
detecting when the memory is becoming full and triggering the decompression of 
previously compressed data objects and the recompression thereof to free up space 
in the memory. 
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2. 

a pluralrty of uncompressed data objects into a single data object, where: 

the object combiner is invoked when the monitor has detected the memory 
is becoming full; and y 

«slT th T' ns to prede " ned ** ,obe " - 

resuftngmthe freeing up of space in the memoiy. 
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data h ^^ em °' daim2Whe * me< * iea ~^-uncx> m p r es S e, 
date objeas ,„<o a s,„ 9 ,e data object when a cos, o, combining the objecte 
d^ned by the sepa,a 6 o„ be*»e„ the objeas , „ under , 
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1 ,Tk 3 ™ here ' n ^ " - °' combini "= is *•«*«■ "y the 

^^^^^^iainc^lnacorabin^^^,,,^ 
to the amount of data included in the objects that »ere to be combined 
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Lac ?d e rr 01 ciaim 2 wherein *■ predef,ned cteia ~ 9 

■MM ob,ects tha, are o, the same type and combining hon.adjace„, da^ 
does not contain any data objects. 



6- The system of daim 1 further comprising a display engine coupted to receive 
uncompressed data objects from the decompressor. 
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7. The system of claim 6 where the display engine is one of the group consisting 
of a laser printer engine, a plotter, and a CRT. 



The system of claim 1 further comprising an embedded computer comprising: 



a program memory coupled to the computer processor; and 

a display engine coupled to receive uncompressed data objects from the 
decompressor; 



the display engine is coupled to the embedded computer; and 

the compressor and decompressor are implemented as computer program 
instructions tangibly stored in the program memory. 



9. The system of claim 1 further comprising: 

means coupled to the decompressor for displaying the uncompressed data 
objects; and 

means for updating a pointer to indicate a next portion of a display area to 
display such that when the pointer intersects a non-empty region the decompressor 
decompresses and outputs the compressed data associated with the non-empty 
region and when the pointer does not intersect a non-empty region the 
decompressor outputs background data. 
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a computer processor, and 



where 
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10. A system for processing data objects each representing display data for a 
page and each having a data type and a locanon on the page, where the page is 
d.v.ded into bands, the system comprising: 
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a memory; 



a display M in the memo^, fc, each bam. of the page fo, storing .hose 
portions of the data objects found in the band; - 

a divider coupted to me dispiay Hat memory ror dividing the data objecte ,„ 
each band ,nto a p, U ra,«y of non-overtappir« non-empty regions ^re each region 
contents „ or part „ „ leaM one date object and each region has a iocafion and a 
region type derived from the data types of the data objects in the region; 

a plurality of compression mechanisms and decompression mechanisms 
"breach common mechanism has an associated decompress™ mec.^ 

a compressors selects oneof me compression mechanisms for each of 
the norvemptv regions acting to companding region type, uses the selected 
compression mechanism * compress the date objects found in the region, thereby 
producing compressed date objects, and stores compressed date objects in the 
memory; 



^^^'t^upledto^memorythatdecompressescompreaseddata 
o jecte to produce uncompressed date objects by app^ng to each compressed date 

Z I' deC ,°~ n — ■? •* impression medranisn, 

used to create the compressed data object; and 

3 ~*» «*<■ -0 the compressor, decompressor, and memory for 
detecng when the memory is becoming ten and triggering the decompression of 

^--^^objec.sandarerecompressiootaeo.tofreeupapace 
in the memory. 



The system of claim 10 further comprising: 
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a rasterizer coupled to the display list memory to rasterize the data objects 
to produce bitmaps stored in the non-empty regions; and 

a raster output device display engine coupled to receive uncompressed data 

objects; 
where 

the compression mechanisms operate on bitmaps to produce compressed 
. bitmap data objects; and 

the decompression mechanisms operate on compressed bitmap data objects 
to produce uncompressed bitmap data objects for the raster output device display 
engine. 



12. The system of claim 1 1 further comprising: 

means for updating a pointer to indicate a next portion of a band to output to 
the raster output device such that when the pointer intersects a non-empty region the 
decompressor decompresses the compressed data associated with the non-empty 
region and outputs it, and when the pointer does not intersect a non-empty region 
the decompressor outputs background data. 



13. A method for processing data objects each representing display data for a 
display area and having a data type and a location in the display area, the method 
comprising the steps of: 

(a) receiving the data objects; 

(b) storing the data objects in a display list associated with the display area; 

(c) dividing the display area into a plurality of non-overlapping non-empty 
regions, each region including one or more data objects or portions of data objects 
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and eaoh region having a tocaUon and a & type deiiwed from ^ ^ 
the data objects and portions of data objects in the region; 

<d, providing a piuralHy o, compression mechanisms and decompression 
mechantsms. where eacrt compression mechanism has an assayed 
o decompression mechanism; 

objectsineach non-empty region byselec(jng 0 „ e 
of .he compressor mechanisms according ,o fhe contending region ^ ^ 
compressing fhe data ob^cfs and portions o, dafa objects in the Renter" 
producing compressed data objects; 

<f) storing the compressed data objects in a memory; 

(9) decompressing each compressed data object by seleCJn, a 
decomprosston mechanism associated w«h fhe compression mechanism used ,o 

croafe^comprasseddateobWanddecomprossingthecomprossed detect 
to produce uncompressed data object; and 

<h) monitoring to detect when the memory is becoming full and triggering the 

thZrr 10 " ^ PreVi0US ' y ™^ m " d3ta ° bJeCtS 3nd - 
thereof to free up space in the memory. 



14. The method of claim 1 3 further comprising the steps of. 

when 3 P ' Ura,ity ° f date ^iects into a sing,e data object 

when the memory is becoming full; and 



compressing the single data object to free up space in the 



memory. 



20 



WO 96/41308 

PCT/US96/09856 

compressed and stoned In I. compressed^ buffer preferably befom a new band 
> wntten into toe uncompressed band buffer, as described below. I n an a„erna,e 
embodiment multiple uncompressed band buffers can also allow rasterizing and 
compressing of different bands to be performed simultaneously. 

8 Affer step 76. or if the band data is no, in a compassed state in s«ep 74. men step 
78 •«**"■—. M me display H entries (objects, o, band A are removed from 
list for band A, rasped Into bfcnaps, and stored in me storage secbon 
of .be undepressed band buffer which hotds the decompressed data from step 76 
Vm storage sec*on of toe uncompressed band buffer thus includes decompressed 

> whrtospace dato (and any piously-compressed rastorized input obiocts, forme 
band from stop 76. and has rasterized bKmap objecto added to H in step 78. 

222 h T 2 '" 9 an *** ln, ° a Mmap ° biect is "* k "- - — 

character mrtlrnes stored in ROM 30 can be reference,, and used to create the 
• M bKmap of toe charactors ofthe to* objoct „a graphics object is to be 
rastonzed, men me graphics primitives making up the graphic* object are rasterized 
accordmg to established memods and combined to torn, me rastorized grephlcs. 
bKmap An Image object may atready be in bKmap form and thus may no, need to 
be rastonzed in oases where a ,-1 correspondence exists between image pixel 
space and ompu. device pixe, apace. ,„ coses where such a correspondence does 
mm* a danslatlon between image and device spaces can be perfonned in toe 
mstenzatorn atop as is well-known to toose sldlted.m ,he ad. The image bKmap 
.b,eot is stored wKh a„ ,he other bKmap objects in me uncompressed band buffer 

*e processattempKs to compos toe rasterized dato of band A that 
^stored m toe uncompressed band buffer. This stop involves dividing toe bitmap 
biecto rnto „on-i„torsec,ing regions, assigning types to toe regions, assigning 
approprrato compression atgorithms to toe regions, and attorning to compress to! 
mgron data rnto a compressed band buffer a, toe current compression level. Stop 
80 is descnbed in greater detail below with reference to Figure 8. 

TIT, T Pr00eSS * ,ermlneS ""^ ** — *' ■« A m in 

toe availabte memory of toe compressed band bu*r. The composed band buffer 
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is preferably implemented in RAM 28 or similar memory. Since only a specific 
amount of memory is allocated in the compressed band buffer for all compressed 
bands, there is the possibility that the compressed data requires more storage space 
than the available allocated amount of memory. Note that, in the described 
embodiment, the process preferably compresses and stores a small portion of 
uncompressed band data before compressing and storing the next portion of 
uncompressed band data. If the process writes compressed data to the compressed 
band buffer and runs out of storage space when data still needs to be compressed 
and stored, then the current band has overflowed the available storage space and 
does not fit. In the preferred embodiment, the process continues to compress data 
and counts the number of bytes of compressed data produced, but does not write the 
compressed data to the compressed band buffer. This allows the processor to 
determine the actual storage requirement of the compressed band. Alternatively, the 
processor can compress and write the overflowed data into the compressed band 
buffer over previously-compressed data for this band until no more data is available 
and the amount of overflowed data is known. 



Since the compressed band data does not fit, the process continues to node 83 of 
Figure 4c, described below. In alternate embodiments, the processor can calculate 
or assume that a certain amount of space is required without having to continue to 
compress overflowed data to find the precise storage requirements. For example, 
the processor can assume that a certain amount of storage space is required for the 
current band based on the compression algorithm (the compression ratio) used and 
how much data was stored before overflow, or by multiplying the available space by 
a predetermined number 

In alternate embodiments, the current band can also be considered not to "fit" if it 
was not compressed within a user's constraints. For example, if the compression 
was not as efficient as expected, the band data would be using more storage space 
than desired and could be considered not to Tit", even though there is sufficient 
memory to store it. 



30 



If the compressed band A does fit in the available memory space of the compressed 
band buffer, then step 84 is implemented, in which the process checks whether all 
display lists have been processed for the page, i.e., whether the display lists are 
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enpty » .here Is anaher dispiay « t0 and compress, men *e process 

~» <o step 72. ff a, dfcpiay «. hava been raster and cmpressad. ,hen the 
P-ccass oonanues ,o step 86. where the pro«ss checKs ,f the las, ^pressed 
5 ~-7 — " — «* Theease where a„ display liste have heen 
- -asterasd and compressed bu the end c «he page has no, been reached can occur 
when display lis, storage is exhausted before all inpu, date o, a page is added ,o 

obiecte from rhe current page need «„ be added .o display Hats. Thus. . 0* L 
compressed display lis, > no, a, me end oftoe page, u,en ,he process conl e 

IT d ^ °' F ' 9Ure ™ hCTe ^ *" * — d a 

*ded tea display »st ttm ^ 0 , me ^ has ^ ^ ^ 

process is complete at 88. 

figure 4o is a How diagram flushing the cn S „ua,ion o, ,ha process 44 shown in 
figures 4a and 4b. The process amves a, node 83 when *. rasters Z 

z:r : * ep 80 does not * * — * ~- *~ - - «J£ 

band brffer. Free, node 83, the process conges to step go. i„ which ,he process 
fenw.es „a higher teve, ofcomp.ssion is availabte. i.e. a a compel teve 

ITT T atowe •* wi " redure me ^ * - •» — 

ZL PreVtoUS * H,86d — " '^e,. P referaU ». oo mpr ession 

W*y o, compress™ levels for each objec, type, where typicMy me more lossy 
oppression algomhms for an ob*c, type are provided a, hfcher ,eve,s o, the 

in sTi 7° * no hl9her co ~ n tev * ,hen a ™ ure - re -» * «— 

-*P * .nd,ca„ng tha, Urere is no, enough memory available ,o store ,he band 
The Process is men compete as indeed a, 93. As a pracsca, matte, , 
number o, oompression levels, Known oompression mtios. ahd a large enough 
compressed band bu«er are proved so ma, me possibilify o, fa,,ure is very Z 
or even non-existent. ^ 
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a higher level of oompression is availabte in step 90, then step 94 is implemented 
mw ^^ne^gheroompres.onlev.iascec.ed. For example, a Ip^ 
leva, magntude can be incremented. ,„ step 96, „ process ^ „ " 
prewous^oompreseed bends have not been compressed a, J^Z 
oompression tevel. This can be accomplish* by che<*ng ,e compressio^e 
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information stored in the band record. If all previously compressed bands are at the 
current compression level, then they have all been recompressed (according to steps 
98-106 below) at the new compression level. The process then continues to node 
97 of Figure 4b t which implements step 80 to compress the band A data at the 
current compression level. 

If any of the previously-compressed bands have not been compressed at the current 
compression level, then step 98 is implemented. - A previous band "B" that is stored 
in the compressed band buffer and was previously compressed at a lower 
compression level is selected. The selection of previous band B can be determined 
by several factors. In the described embodiment, the first compressed band in the 
compressed band buffer is chosen. In other embodiments, different bands can be 
chosen depending on how many bands are to be reanalyzed and recompressed in 
the implemented embodiment (described below). For example, only the single band 
just previous to the current band A can be chosen. 

In step 100, the selected band B is decompressed into the uncompressed band 
buffer using information stored in the band. Preferably, band B is decompressed into 
a "second" band storage section of the uncompressed band buffer so that both band 
A and band B are simultaneously stored in different storage sections of the 
uncompressed band buffer. To decompress band B, decompression parameters 
from the compression band buffer are retrieved. These parameters include the 
compression algorithms used to compress each region in the band and other 
parameters, as described in greater detail with respect to Figures 8 and 12. The 
process decompresses the previous band B, region by region, back into the second 
storage section of the uncompressed band buffer based on the decompression 
algorithms associated with the compression algorithm used for each region. The 
decompression algorithms perform the reverse operation of their associated 
compression algorithms. Note that an entire region is decompressed at a time from 
the compressed band buffer to the uncompressed band buffer, which is different 
from scan line decompression to a output display device as described with reference 
to Figure 13. 
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JZZ Z process attempK to band B da,a ** »• «~- 

M boKor attoe crrem ^ |s accompfehaj sm 

80 o, Figure 4b. and is described in greater detoi, w*h reference to ^ 

Thrsste - accomplrshed simitedy to step 82 as shown ,„ R gure 4b . CompresSKj 
band EJ typically since » ^ 

sing *e previous compression level, and .nee the compression 
omen, compression ,ev« usuail, achieves a hi 9 her compress^ rah J££ 
be,ng more fcssy than me pre^ous compression ievei, to alto w ^ * ^ 

'or exampte. ,o me data of band a no, being p,^ ^ , 0 ; 
compression atoomhn, e.g.. a Abased compress™ algorthm being ZZ 
^data. , f band B does no, fit, men step tos ta implemented. ,„ J^B 
- impressed a, me previous, lower compression teve, „«, „ ^ ^ * 
compress band B su^eney ^ precess then reh™ to step go ,o a^Z * 
me current compression level to the next higher level. 

I, compressed band B does fit in the expressed band bufter in s,ep ,04 then step 
I..— .he implemented policy „ ohecKed. „ the ZZ 
embodiment, me policy is to recompress afi previous bands a, the ^ 
compression ,vel. Th* poficy *ws a» data o, me same type win 
.he same duality on me entire disptayed page, since a,, of J band ^ 
compressed a, me same compress™ level havi^ about the same lossinT Z 
aher step 108. the process returns to step gs ,o compress anchor previom bana^B 
^^P-.ouebandaareoore^,,^^^^ 
previa bands have been repressed, cunen, band A is comp 2 ed ! " 
«M compression tevel. as shown in Figure 4 b. . band A fits, men the pre^ 
rasters and compresses «. nex, dispiay lis, as shown fa F*„re 4b. 

A^afively, a policy can be imptemented in which oniy jus, enough previous bands 
,0 allow the current band A to * in the compressed band oT 

*e meutod o, lecompressing a„ prevmus bands (depending on he y previous 
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bands have to be recompressed at this stage for other bands). However, in such an 
implementation, the quality of displayed objects may vary due to different 
compression levels being used on different bands. For example, defects might be 
visible between a portion of an image object in one band that was compressed with 
5 one compression algorithm and the remaining portion of the image object in an 
adjacent band that was compressed with a different compression algorithm. If this 
policy is used, then, after step 108, the process continues to node 97 of Figure 4b, 
which causes band A to be compressed at the new compression level and checked 
if it fits. Alternatively, the process can determine when enough storage space has 
1 0 been freed by comparing the saved space from the recompression of band B to the 
known additional space needed for the current band A. " 

The process of rasterizing and compressing output data as described in Figures 4a, 
4b, and 4c can be implemented in software and/or hardware. In one embodiment, 
the objects of the input data can be rasterized and the display lists, data structures, 

15 etc. can be stored through the use of software, while the 
compression/decompression can be implemented in hardware using gates, an ASIC 
(as shown in Figure 2a), etc. In other embodiments, the entire process can be 
implemented using software (or hardware). In many instances, however, a full 
implementation in software currently causes output data to be displayed too slowly 

20 for many applications. 

Figure 5 is a flow diagram illustrating step 66 of Figure 4a, in which the type and the 
bounding box of an input object are stored in the appropriate collectors for the bands 
spanned by the object. The process begins at 130, and, in a step 134, the process 
checks in step 134 if the new object can combine easily with a stored object of the 

25 same type that is stored in the collector. The objects stored in the collector are each 
examined and compared to the new object to determine whether the objects can be 
easily combined. An "easy" combination can be indicated by a number of conditions. 
In the preferred embodiment, if the bounding boxes of the new object and a stored 
object have equal or nearly equal Y coordinates for the top and bottom edges of the 

30 bounding boxes, the bounding boxes are no more than a small distance apart in X 
coordinates, and the objects have the same type, then the two objects are "like- 
objects and can be easily combined. These conditions also apply to objects having 
the same type and having equal or nearly equal X coordinates for the left and right 
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edges of the boundingboxes and which are no more than a sntai, distance apart in 
V coordinates. Additional two 0 „ iects ^ ^ „ eas% ^ 

bounding box of one object is posHioned enSrely wi„ in another objects bounding 
box, and if the objects have the same type. 

« » the objects can be combined easi*. then step 1 36 is implemented, where the like 
objects are combined, and the process is comptete at ,46. This combination step 
■ described in greater detail with respect to Figure 6. „ the objecte cannot be 
combined easily, then the process checks in step 140 i, sufficient storage „ mmt , 
in the approphate collector to store me type and boundmg box lnformatlon 
object. , mere is sufficient storage, men me p ro cess adds me object to the elector 
» step 144. as detailed betow. „ there is no, enough storage, men step ,42 in 
lamented, in which a number of object combinations are forced to „ee storage 
,n the collector. Combining objects frees storage, since two combined objecte are 

instead o, two separate sets. The process of forcjng object combiners is 
descnbed in greater de W with respac to F,g„re 7. Arter object combinations ha»e 
been forced, storage is freed in the collector and step 144 is implemented. 

instep 144. thetype and bounding box of me new object is stored in theapprophate 

collector,*,. A.ermeobjectintormabon^sbeenadded.theprocessiscompiete 
^0 as indicated at 146. 
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Figum 6 is a flow diagram i..ustrating step 136 of Figure 5, in which like objects are 
combined within a coHector. The process begins at 148. and. in step 150 the 
bo.und.ng box coordinates are retrieved for the new object and the stored ".ike" 
object. For examp.e. in the described embodiment, a bounding box has four 
coordinates. The coordinates of the objects" bounding boxes can be specified as 



For the stored object: 



X L = X coordinate of left edge of bounding box 
X R = X coordinate of right edge of bounding box 
Y T = Y coordinate of top edge of bounding box 
Y B = Y coordinate of bottom edge of bounding box 
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and for the new object / 



X' L = X coordinate of left edge of bounding box 
X' R = X coordinate of right edge of bounding box 
Yy = Y coordinate of top edge of bounding box 
Y' B = Y coordinate of bottom edge of bounding box 



In next step 152, any bounding box coordinate of the stored object are replaced with 
the corresponding bounding box coordinate of the new object if predetermined 
10 conditions are met. In the described embodiment, these conditions are as follows: 

Replace X L with the minimum of (X L> X' L ) 
Replace X R with the maximum of (X R , X' R ) 
Replace Yy with the maximum of (Y T , Y* T ) 
1 5 Replace Y B with the minimum of (Y B , Y* B ) 

Thus, a stored object's coordinate in the collector is replaced with a corresponding 
new object coordinate only if the new object has a smaller or larger coordinate, as 
appropriate. Once these replacements have been accomplished, the process is 
complete as indicated at 154. 

20 For example, in Figure 4e, a band 1 12 of a page 1 10 is shown. Text object 1 24 has 

been previously stored in the collector of band 1 12. Text object 126 is a new object 
that is to be stored in the collector of band 1 12 as well. In step 134 of Figure 5, new 
object 126 is found to be adjacent to text object 124 and has the same type (text) as 
object 124. Objects 124 and 126 therefore qualify as "like" objects, and are 

25 combined in the process of Figure 6. Both objects have the same left and right (X) 

coordinates (i.e., X L = X f L , X R = X' R ), and the bottom Y coordinate of object 124 is 
the same as or is nearly equal to the top Y coordinate of object 126. In step 152, 
coordinates X L and X R remain the same, coordinate Yj remains the same, and Y B 
is replaced by Y'g. The new, combined object 135 thus has a bounding box having 

30 a left side at X L , a top side at Yy, a right side at X Rl and a bottom side at Y'g. 
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F-gure 7 » a flow diagram illustrating step 142 of Rgure 5. in which a number of 
object combinations are forced to free up storage in the collector for the new object 
PreferabV.omy objects of the sametypeareforced into combinations in this process 
142. ,n the described embodiment, the number of combinations is an adjustable 
parameter that is greater than or equal to 1 which the user can set before the 
process of the present invention is implemented. For exam P .e, a minimum of. 2 
comb.nations can be selected. The minimum number of forced combinations can 
depend on the specific applications of the user. 

The process begins at 156, and in step 158. the process examines stored objects 
having the same type in a collector for combining purposes. In one embodiment 
each object's bounding box and type is compared to every other object's bounding 
box .and type in the collector, which can be accomplished according to one of severe. 
we.Uknown method, For each collected object, the cost of combining the object wKh 
eachothercollectedobjectofthesametypeiscomputed. The "cost" of combining 
*o objects is dependent on the area of the resuming combined object, the separation 
d-stances between the objects, the sizes of each object, and even other parameters 
such as time required to perform the combination, etc. An exam P .e of a cost function 
used for computing the cost of combining objects is as follows: 



20 



p » 



+ays] + a 4 s 2 y 



where 

af, a 2 . a 3 and a 4 are tuning parameters, 

A u = the area of the bounding box that would result from doing the 
& combination, 

A p = the area of the first bounding box in the proposed combination, 

A q = the area of the second bounding box in the proposed combination. . 



PCT/US96/09856 

Aj - the area of the intersection of the boxes that are proposed to be 
combined, 

S x = the minimum separation of the boxes in the X direction (zero if X 
coordinates overlap at all), and 

S y = the minimum separation of the boxes in the Y direction (zero if Y 
coordinates overlap at all). 

This function provides the cost, C, which is used in later steps. The first term 
of the function provides all the area that would be included in the combined object 
which is not included in the original two objects, i.e., the extra whitespace that would 
have to be included. Preferably, as little whitespace as possible should be included 
in a combined object, since compressing whitespace is wasteful of time and memory 
(as explained below). The second term of the function is similar to the first but 
provides a ratio to compare areas. The third and fourth terms provide the separation 
of the two boxes is X and Y directions, respectively. The tuning parameters a 1t etc. 
can be used to emphasize particular terms of the function. For example, if a user 
believes that the first term of the function (i.e. the a-\ term) is more important in 
determining cost than the other terms, then the parameter a-, can be increased in 
value and the parameters a 2 , a 3 , and a 4 can be lowered in value. A wide variety 
of other functions can also be used in other embodiments to provide a cost number 
reflecting these and/or other cost parameters. 

In step 160, the process selects the bounding box coordinates of the object pair 
having the smallest cost of combination as computed above in step 158. The 
bounding box coordinates for the two objects are retrieved as described in step 150 
of Figure 6. In an alternate embodiment, in step 1 58, the cost of combining an object 
with another object can be calculated for different pairs of objects until a cost C of 
combination results that is less than or equal to a designated threshold. Thus, in 
step 160, the object pair that first met this threshold would be selected. This 
alternate method can save computing time over the embodiment described above, 
since costs of object combinations are calculated only until the threshold is met, not 
for all the object combinations in the collector. 

In next step 162, the two selected objects are replaced with a new combined object 
having the same type as both the objects and having each bounding box coordinate 
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from one ofme ^ * ieas . ^ coordin^, me ^ ^ 

daermined using me mediod 3, descrtbed ^ h s(ep , M of ^ » 
164. g. process checks wtamer me desired number of combinabons naue ^ 
coated. As explained above, a predefine, number * combinabons can be 
se. before me process beg™. „ the desired number of combMons has been 
competed, then „e process is comptete a, 166. „ no,, then „. p, ocess 

"*~ons are possible d .here are a, leas, obiecte ,„ tne „ 
Ma* one ob.ec, »pe. „ mom commons are possiNe, ma process re,ums ,o 
s,ep ,68 ,o compute ,he cos, for tero objecte baving *e same <ype as a,read» 
computed, or for ,wo obiecte have a „pe differen, „o m „ J£ any 

:!rc~ i,nomore ~ ra -^-— *~ 

Figure 8 is a flow diagram i,,us,ra,ing step 80 o, Figure 4b. where the process 
^ .ocompmssmedateofbandA. Th. . accomp.ished b y d« ng me band 
0*0* ,n,c , non-intersecbng regions, assigning compression aigoddims ,o .he 
-g.ons, and abempUng to compress the band, as described beiow. The process 
*~ a, ,80ln step 182. a se, of non-intersecbrto ^ , 

a, , Obieote ,n the band is found. This is accompiisbed using ,be type and bounding 
box ,nfom,abon stood in I, coHecto, assayed wlm m e band, and is described in 
greater detail below witti reference to Figure g. 

Figure 4f is a diagrammabo iliusbason o, band 1,2 o, Figure 4e tei „g dMd ed i„,o 

A n^ber o, no„-,„terseo,,ng regions ,28 are proved 

over and surrounding objecte ,27. 135, and 137 as a resul, of step ,82, A "region 

as tefened to herein, is a non-ovedapping rectengular area in a band marcovers" 

29 ~" ^ ■"*' <* *• ^me o, regions ana empfv regions 

^ which mcude on,y wh„espaoe and cover no obiecte (i.e., include no objec 

b, e«s. A„ regions are preferab* stored m a separate "region buffer" o, memory 
sue as RAM 28,. Each region is defmed by a date slructore whteh mcludele 

desenbed below and with reference to Figure 9a. 
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Refemng back to Figure 8, steps 184-188 assign object types to the non-intersecting 
regions 128 found in step 182. In initialization step 184, each region is assigned an 
empty set of types and each region's "marked" flag (also preferably stored in the data 
structure) is set to false. The marked flag is used to distinguish whether a region has 
5 an empty type or not. An empty type indicates that the region covers only 
whitespace and no objects in the band. In iterative step 186, a counter "i" is 
initialized to 0 and is compared to the number of objects in the band. Each object 
in the band is uniquely numbered and considered OBJECT(i). If i is less than the 
number of objects in the band, then step 188 is implemented. 

10 In step 188, for the set of regions covering OBJECT(i), the type of OBJECT(i) is 
added to each covering region, and each region's marked flag is set to "true." Since 
non-intersecting regions that cover the objects were found in step 182, all regions in 
the band either cover an object with the entire area of the region, or do not cover an 
object at all. Only regions that cover OBJECT(i) are processed in step 188; the 

1 5 coordinate data stored in the region data structures 221 and X- and Y-arrays can be 

used to determine these covering regions. If the type of OBJECT(i) is the same as 
a type that is already stored in a covering region, then no new type is added to that 
region. A region may cover two or more types of objects and thus may be assigned 
two or more different object types over different iterations of steps 186-188; a region 
20 having more than one object type is considered to have a "complex" type. The 
"marked" flags of the covering regions are set to true, indicating that these regions 
have been marked with a non-empty type. The process can later examine the 
marked flag to distinguish regions that have non-empty types and regions that have 
empty types, where a "true" flag indicates the region has a non-empty type. 

25 For example, in Figure 4f, region 133 covers both text object 135 and graphics object 
127. For example, object 135 is OBJECT(1) (Le., i = 1) and object 127 is 
OBJECT(2) (i.e., i = 2) in the loop of iterative step 186. Region 133 is a region 
covering a portion of OBJECT(1) and a portion of OBJECT(2). Thus, the type of 
OBJECT(1) (i.e., text) will be added to region 133 when i = 1, and the type of 

30 OBJECT(2) (i.e., graphics) will be added to region 133 when i = 2. Region 133 
therefore has both text and graphics types, i.e., a "text-graphics" complex type. 
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Mer step 188. me process returns to stefw t0 incnmm ^ . ^ 

OBJECT,,). Once every object has had each covering region processed, tan , »„ 

be greater than the number of ejects in me band in step 186. The process men 

continues to step 194. where a -best- compression algorithm is assigned ,o each 

mm based on me type o, each region and c*er lactore. The W compression 

*gon.hm for a reg.cn is esrimated to produce the best compression rario for me 

combnaton of object types induded in me region wHhou. sacnScrng me oua«y of me 

displayed image derived from me region Preferablv almHth™ 
i „„, h „, . " Hera dly, algorithms are assigned based 

on me current compression level and the type of the region. 

^preferred embodiment, aigorilhma to assign ,o regtons are referent in tables 
stored ,n memory, as descrfbed below v*h reference to Figures 8a and 8b The 
current cypress*, leva, « object types o, a region are proved ,o me labies ,a 
re^vemacc^spondingw^orimmformatregion.userconstraimsofou^.y 

12? 7 a compresston * omhm *" «— I *- 

gal^oro^ofmu^typasolaregionn^nauchiaveasufri.ent^essten 
a„o for me other type. There thus may be a tredeofr be, isua , ^ J" 

mpression redo for different types (such as tax, and image types, which can be 

determined by user consfraints. The compression algorithm assigned to a region is 

Patera*, store, in ,he dam sfructure of tha, region, as shown beiow in F^ ga 

h, other embodiments, omer consfraints can hetp determine which compression 
uch 7 7 7** eSPeda " y »"■"*».'-** — — (mu W p,e, types 
L a o T 9raPhlCS CT 9raPh '° S a " ^ ~* - 

^TTu. T^T^^^^^^ 

are to be used over me entire page to provide a uniform quality image or can 
-~m» . pabular minimum compression ra, to ,o be used over me entire page 
b^d on he ava«e storage space forme enrire page. The precess can exami a 
dtferen, compression ratios of bands andfor regions o, me page tha, have been 

data „ collectors and ,n ma band record. For example, a region can be assigned th 
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same compression algorithm as a region across a band boundary. The time to 
compress or decompress a region can be different depending on the algorithm used 
and may be of concern to a user in a particular application. 

In an alternate embodiment, a region having a complex object type can be assigned 
a single type, where the single type is one of the types of the region. In such an 
embodiment, for example, the commands associated with an input object (received 
in step 64 of Figure 4a) could include information on how the object is displayed in 
relation to other objects. For example, the input object data could include information 
specifying if each object is transparent or opaque when displayed, and the "layering" 
of the objects on the screen, i.e., which objects are displayed over other objects. 
Using this information, step 194 can determine which single object type should be 
assigned to a region having a complex type based on the layering and transparency 
of the objects. 

In next step 196, the regions are examined and any eligible regions are combined 
with other regions based on specified criteria. These combinations are accomplished 
primarily to reduce storage space requirements of the regions according to, for 
example, limitations of hardware implementing the process. The combination of 
regions in this step is described in greater detail below with respect to Figure 1 0. In 
next step 198, the regions of the current band are attempted to be compressed into 
the compressed band buffer according to the assigned algorithms for the regions. 
Different compression algorithms can be used on different object types in a band to 
store rasterized bitmaps in relatively small storage space compared to the storage 
space needed if no compression or if a single compression algorithm were used. 
The steps of compressing the regions and storing them in the compressed band 
buffer is described in greater detail with respect to Figure 12. As explained above 
with reference to Figure 4b, the band data may not fit in the available space in the 
compressed band buffer. After the band is attempted to be compressed, the process 
is complete as indicated at 200. 

It should be noted that, in the described embodiment, the assigning of a compression 
algorithm to objects (step 194) and object combinations (step 196) are performed on 
rasterized object bitmap data in the uncompressed band buffer. Alternatively, 
compression algorithm assignments and object combinations can be assigned before 
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objects are restetfeedand stored in the united band batter, such as before 
step 78 of Rgure 4b. Also, assigning algorfthms and combining can be performed 
a. any tone after ftte band disptey lis, has been bufi, but before perfomfing the actual 
compression of the band. 

= Figure 8a shows an example of an algotfthm look-up table fha. can be used to 
prewde algorithm assignments to a region in step ,94 of Figure 8. tn the described 
embodiment, me algorithm lockup table is stored in ROM 30 and can be ufilized in 
conjuncbon wfth indexing table 205 (descnbed below, to determine what combktadon 
of avaftabre compression atgohthms to assign to a region. A number of algonthm 
enures 201 is provided in table 202, where each algorithm enay 20, indudes an 
xfenbfier 2, 2. one or more specified compression atgorHhms 203, and compression 
parameters 204. Preferabty. an atgo«m enby 20, is accessed usk, a algotfthm 
-enbfier 2,2, and me akjomhm.s, 203 and paremetere 204 are men pll and 
ess^ned ,o me region. For example, ft algonthm entry , is accessed men the 
compression atgorfthm LZW is to be assigned wfth the corresponding parameters 
~ infield 204. „ afcorimm enfty 5 is acssed, men fire comp Jon ajhm 
LZW is to be cascaded wfth a Differential Pu,se Code Modulation (DPCM, pro ces S 
and assigned wfth the parameters in field 204. Cascaded algotfthms operate by 
pre-processing" me da* using one atoorithn, (such as DPCM), and then 
compressing the pre-precessed data with me other atgorfthm (such as LZW, 
Cascaded algorithms can be used to achieve dWeren, compression ratios than when 
using an atgonthm atone. The algorfthm enmes 20, are accessed by me indexing 
table 205. described below with reference to Figure 8b. 

Some algorithm entries 20, have the same algorithms listed in field 203 but have 
ddferen, parameter* listed In fiek, 204. expression parameters are provided to 
adjus, me compression process, and are we. known ,o those skilled in me ad For 
example. ln . DCT-hased algorimn, a se, o, guantofion concents, a mreshold 
to shtft coemdente, etc.. can be specified: in UW, a pointer widm can be specified 
ete. Afferent parameter can provide differen, compression ratio and compression 
quakfies to different afcorithm entries. For example, algorithm entry , assigns LZW 
«* PARAMETERS ,, whilealgorimm enhy3 assigns LZWwfth PARAMETERS 3 
Enfty , may compress texf a, one compression ratio and quality, while enfiy 3 may 
compress text a, a different compression ralio and quality. 
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It has been found that certain compression algorithms compress certain types of 
regions more efficiently than other types of algorithms. Thus, the described 
embodiment as shown in table 202 provides the LZW compression algorithm for text 
regions, the LZW compression algorithm for graphics regions, and a discrete-cosine- 
5 transform based (DCT-based) compression algorithm (such as JPEG) for image 
regions. A Pixel Depth Reduction (PDR) algorithm can also be provided for cases 
when a deterministic compression ratio is needed, i.e., a compression ratio that is 
exactly known prior to compressing (other types of compression ratios are 
estimated). These algorithms, or cascaded multiple algorithms, can also be 

10 assigned to complex object types depending on user constraints, as described 

below. Other standard compression algorithms, such as Wavelet, RLE, Huffman, 
etc., or even non-standard algorithms, can be assigned to different object types and 
quality levels. Other types of algorithms can be cascaded, as well. For example, 
LZW or Huffman coding can be cascaded with a Run-Length Encoding (RLE) 

15 algorithm. The implementation of these compression algorithms (and 

decompression of data compressed with these algorithms) is well-known to those 
skilled in the art. 

Figure 8b shows an example of an indexing table 205 which can be used in step 194 
of Figure 8 to assign an algorithm entry 201 (as shown in table 202 in Figure 8a) to 

20 each non-empty region of the current band. Indexing table 205 is stored in ROM 30 

(or RAM 28) and can be utilized to assign an algorithm entry 201 according to object 
type and compression level. Indexing table 205 includes entries for different 
combinations of object types 206, which are text, graphic, and image in the described 
embodiment. For each possible non-empty combination of object types, there is an 

25 entry group 207, Thus, there are seven different entry groups 207 in the described 

embodiment, one group for each non-empty combination of three object types. 

Each entry group 207 includes one or more index entries 213. In the table 205, three 
entries 213 are shown in each entry group 207, but any number of entries 213 can 
be included in other embodiments. An entry 213 points to an algorithm entry 201 in 
30 algorithm table 202 which is to be assigned to a region. Preferably, each entry 
includes three fields: an algorithm entry field 211, a quality field 208, and a 
compression ratio field 209. The algorithm entry field 21 1. stores a pointer (such as 
an identifier) to an algorithm entry 201 in the algorithm table, which is described 
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(beaded, atgomhm conation to be assign*, ,„ . ^ ^ ^ 
■nrteates *e estimated guai* (0 , ^ 0( ^ ^ ^« 

> M « in.ca.es the minimum cnen, concession ^ ^ „ J££ 
assign me algomhm en,„ in H », „ . ^ The ^ 

damned above in steps 54 and 94 of Floras 4a and 4o. The compression raBo 
« 209 mdrcates .he elated ^ rafc > * 

jnus m9thea , ortthmentryinWd211 Po^xan^eaoo^oLj,.,: 
.nd^tes thai me date is elated te be com P ressed alai1 ratto . Ty ^ £ 

afconthm and .he grea.er.he compression ratio infe|d 2Q9 m ° re '° SS! ' 

meete he con^te of object lyP es 20S and compression ieve, 208 for IbaJnby 
213. add-on, oonsbaws of compression ralio may a, so to used „ * 
ei*v213ina 8 rou P 207foraregion. 

Forexampte, nation Rhas an obieatypeoftexlon.y.then.he process examines 

£ r~ r and 9roup 2073 — * - £ 

text. Three ,ndex en.nes 213a. 213b. and 213c are included in group 207a 
Assuming curIen , ^ ^ ^ ^ ^ ^ ^ 

se.ec.ed, since * q ua,i.y M , s o. and only entnes having a q ua,«y «e,d 2tJ8 tess 
■■^^-.^-.M.^ TheLemrym 

TT 21 1 ,0 **" 1 h "* 202 of * - wl. » 

^dte.^esuntetedcomp^ionraeoforaigodtemee.r,, is2 . a ^ 
enby 1 provrdes a afeomhm (and parameters, te be assigned te region R 
wh^rssuitebiefortextccmix-ession. region K, 

-*» 213. or one second en*y 2,3b could be setected for region R. Enln , 213a 
^ a compression ra*o of 2.0. and enby 2 13b P ro*des a compress^ o 
5.0 Thus, user constraints can dictate which entry to select. If higher quality is 
deared. then entry 21 3a can be selected- if tw,h„ * 
ran oe selected, if higher com P ression ratio is desired, men 
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entry 213b can be selected. If region R has a complex type, such as text-image, 
then an entry 213 from group 207b would be selected in a similar fashion. 



Figure 9 is a flow diagram illustrating step 182 of Figure 8, in which a set of non- 
intersecting rectangular regions that covers all objects in the current band is found. 
The described process of Figure 9 is only an example, since there are many possible 
methods to provide non-intersecting regions from object bounding boxes. The 
process begins at 210, and, in step 212, an X-array is created having all X 
coordinates that describe left or right edges of object bounding boxes in the band. 
The left and right edges of the band are also included as X coordinates in the X- 
array. For example, X coordinates 139 as shown in Figure 4f are stored in the X- 
array. 

In step 214, the X-array is sorted in the order of increasing X coordinates, and 
duplicate X coordinate values are removed from the array. The resulting array thus 
includes nX values. In step 216, a Y-array is created having all Y coordinates that 
describe top or bottom edges of object bounding boxes in the band. The top and 
bottom edges of the band are also included as Y coordinates in the Y-array. For 
example, Y coordinates 141 as shown in Figure 4f are stored in the Y-array. In step 
218, the Y-array is sorted in the order of increasing Y coordinates, and duplicate Y 
coordinates are removed from the array. 

Finally, in step 220, the band is divided (or "partitioned") into (nX-1)(nY-1) 
rectangular, non-intersecting regions. Each region can be labelled as R; it where 0 

< i < nX-1 and 0 < j < nY-1 . The extent of the coordinates (X, Y) of region Ry is thus 
Xj < X < X j+1 and Yj < Y < Y J+1 , where Xj is the ith X coordinate in the X-array (0 

< i < nX), and Yj is the jth Y coordinate in the Y-array (0 < j < nY). Note that, since 
discrete pixels are being displayed, two regions do not have the same coordinates 
on an adjacent edge. Thus, one region would have a right edge X coordinate of Xj - 
1 , and an adjacent region to the right would have a left edge X coordinate of Xj. The 
process is then complete at 223. 
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As shown in Figure 9a, each region Rj j created in step 220 preferably includes a 
data structure 221 stored in the region buffer. The region data structures are 
preferably ordered in "raster display order" (i.e. scan line order) in the region buffer 
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90 

porting to the top m comere of „ ^ „ ^ ^ ^ retrie>e 

the regions in thb orter. as describe betow with reference to Figure 13. The dafe 
*«ure ,221 of me described embodiment mdudes a number of 5e.de which inciude 
masler «ag 222, stave 5ag 224, mariced 5a, 226. X Wex 228. V index 230, and 
object types 232. other forms of data structure 221 can be used In other 
embodiments. Master 5ag 222 and siave flag 224 are used to imptemen, region 

-mbmanons.andarede.aitedbetowwithreepecttoF.gures.Oandll.Ma^d.ag. 
226 . used to mark whether a region has a nonempty type or an emp„ type (t ree 
or false, reepecBvely), as described above. 

hzl w t v index 230 descniK *• ,xa ^ * ** <" te ™» * w— 

tnto fhe X-anay and V-array, respecbvely. and preferably renge from 0 to 
ft. «. of regtons in their respectfce directions. These indexes speoify a region 
by «ie regtoris lower M coordinafes. For example, an ,X Wax, V index, of (1 2) 
speedy the region R 12 , whioh is second from the teft edge of the band and «d 
^.hetc* edge oflhe band; fhecoortfcaesof region R, 2 ren^m the second 

^^Vooord.nata.na.eY-anayfe.hefotmhyooordinateln .heY-array (minus 
1). Theee indexes appiy whenthe region is ne»her a master or slave. Iftheregion 
- e "aster, X index 228 Indexes the ooordina.es of ,he diagonaly opposite slave 
regton. 2 ,he region is a slave, the X and Y indexes 228 and 230 index the 
coordinates of the slave's master region. 

Objeo. type 5e,d 232 epecffies all the object types which the region covers. In the 
descnbed embodiment, this is impfemented as a series o, bits, where one bi, is 

.nch,dedforeachp«sib te c* j ec.,ype,no,inc l uding m e-em W y-,ype,. tfabilison 
feraoena* type, then the region covers an object oflhattype. Data sbucture 22, 
atso stores offter infonaadon needed for compression/decompression of me regions 
such aa the location of ,he region in me uncompressed band buffer „, gLai 
parameters aucri as pixe, depth and number o, pixels on a scan tine for Ute region 
wh.cn are used by the compression process as described w«h reference ,o F^ure 

Note that clher methoda can be used in atternate embody ,o provide a set o, 
non-tnteraacting regions that cover the band. For exam*, a method u« Wng „ nte d 
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lists instead of the preferred coordinate array method described above can be used. 
In the linked lists method, each region can initially correspond to each object (as 
specified in the collector for the band) and can have a data structure including a 
bounding box and type description. Each of these region data structures can be 
included in a linked list, as is well known to those skilled in the art. If two regions 
intersect each other, then those regions are removed from the linked list and are 
divided into non-intersecting regions, and these non-intersecting regions are inserted 
into the linked list in place of the intersecting regions. Methods of manipulating 
linked lists as such are well known to those skilled in the art. Each two adjacent 
regions in the linked list can be similarly examined and replaced with non-intersecting 
regions when appropriate. 

Figure 10 is a flow diagram illustrating step 196 of Figure 8 t in which regions are 
combined based on specific criteria. The process begins at 240, and, in a step 242, 
each row of regions is examined. A "row" of regions refers to all the regions in a 
horizontal row of the band (those regions having the same Y coordinates). A 
region's assigned algorithm is preferably compared to the assigned algorithms of the 
regions to the left and to the right of that region. In each row, adjacent regions that 
have been assigned the same compression algorithm are combined. Two regions 
can be considered "adjacent" if there are no intervening regions between the two 
regions. A method for combining regions is described in greater detail with respect 
to Figure 11 . Preferably, two regions are combined, and the combined region can 
then be combined to additional adjacent regions if the algorithms are the same. This 
is the least "costly" combination of regions that can be accomplished, since no 
compromises in quality are made and storage space is saved. Thus, this 
combination is preferably performed prior to other region combinations, which are 
detailed below. 

In next step 244, pairs of non-empty regions having the same assigned compression 
algorithms are combined with empty regions separating the pairs if hardware 
constraints are violated on that row of regions. The hardware constraints of the 
described embodiment typically include a limit to the number of regions that can exist 
on a horizontal scan line. This limit is dictated primarily by the amount of available 
memory, e.g., in the ASIC 38. Thus, if there are more regions in a row than the limit 
allows, the hardware constraints have been violated. In step 244, intervening empty 
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regions are included in a combined region ^reduce the number of regions in a row 
n. all adjaoen, regions with like compression atgorithms were already combined 
■n step 242. For exampte. as shown in Figure 4f. if region 243 were assigned the 
same compression algorithm as region ,37, and . was detemrined that mere were 
> oo man, regions in M row of regions, men me pair o, regions 243 and , 37 would 

be combined with entpty region 245 to form a combined region. The method of 
oombmmg regions is described in greater detail with respect to Figure f 1 Again 
combmed re g to „ s ca „ ^ „ be ^ ^ 

congas are met. The combiners performed in step 244 are more •'costly than 
me combinations of step 242. since amp* whhespace (background) date is being 
■nauded ,n a regmn. Ths causes empty space to be compressed ahd stored in the 
composed band buffer, which is ine ffi c«nt Ideally, only regkms having object date 
and no empty apace are desired so that only object date is compress* into the 
compressed band buffer. 
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In Ute* atep 246. the process checks whether the hardware consents are still 
vrolaed ,n any row of regions in the curren, band. „ so, then step 248 is 
■mplemented. in which addSona, region combinaffons are forced within are vioiating 
row. Preferably, regions havmg a small -cost- o, cambination am combined firs, 
18 ^ retf ° n C ° mbina4 °" is P— * based on ,he esfimated amount o, 
compressed storage required for the combined regions in excess of me estimated 
amount ot compressed storage required for theindivrtua, regions. For exampte i, 
-wo regions R1 and R2 are estimated ,o require B, and B2 byes «, sforage 
respecbvely. when separately compreased. and are estimated to require B bytes 
whenoombinedandcompressed.mecos.ofttrecombina.ionisB.rB, , B2) Tnis 
costcansomefimes be negate, *oe .here is a cedain amoun, o, incompressible 
sfor^e overhead- aasooiated w«h each region; combining me regions afiows me 
overhead ,o be shared in one combined region. 

inws step 246. even regions having dNferen, assigned compression algohmms may 
tavern be combmed in order fo reduce ,he number o, regions. Thus . „, step J 
*. -os, cos„y and leas, desirabie type o, resion ^ 
to* may no, be compreased *h an effioien, afcouuan as a resuff. I, necessary 
algonmm assignments can be changed i, regions having tvm d*feren, types are 
combmed. For example. „ a ,e» and image regions have to be combine, in mis 
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step, then the assigned compression algorithms can be changed to an algorithm that 
provides better quality to a text-image complex object type. The region combinations 
can be performed as described with reference to Figure 11. 

After step 248, the process returns to step 246 to check if hardware constraints are 
5 still violated on any row of the band. If they still are, then step 248 is repeated as 

often as necessary. Once the hardware constraints are no longer violated, step 250 
is implemented, in which vertically adjacent regions are combined when possible and 
when the "cost" is within limits. The "cost" here may be specified similarly as in step 
246. The vertical combinations are accomplished as described with reference to 
1 0 Figure 11. The vertical combinations are preferably accomplished after all horizontal 
combinations are completed in steps 242, 244, and 248. 

Figure 1 1 is a flow diagram illustrating the method of combining regions in steps 242, 
244, 248, and 250 of Figure 10. It is assumed that a group of two or more regions 
are desired to be combined. The method starts at 260, and in. a step 262, the lower 
1 5 left region of the group of regions is designated the master region. The rest of the 
regions in the group are designated slave regions of the master region. This is 
accomplished in the data structure 21 1 of Figure 9a by setting the master flag to true 
for the master region and setting the slave flag to true for each of the slave regions. 

In step 264, the object type of the master region is augmented with all the object 
20 types of the slave regions. In the described embodiment, this is accomplished by 

setting the bits in the object type field 232 of the master region to all types included 
in the slave regions. Any duplicate object types are ignored. In step 266, the master 
region is marked with the boundaries of the set of slave regions. In the preferred 
embodiment, the master region's X-index and Y-index are set to the indexes of the 
25 slave region furthest diagonally opposite to the master region (i.e., the slave region 
that is furthest to the right and above the master). In step 268, each slave region is 
set to point to the master region. In the data structure 221 of Figure 9a, this is 
accomplished by setting the X-index and Y-index of each slave to the indexes of the 
master region. 
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For example, if two horizontally adjacent regions are to be combined, the leftmost 
region is the master and has an X-index and Y-index of the slave region on the right 
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15. The method of claim 14 wherein objects are combined when a cost of 
combining the objects, determined by the separation between the objects, is under 
a predetermined threshold. 



5 16. The method of claim 1 5 wherein the cost of combining is determined by the 

amount of background data that is included in a combined resulting object compared 
to the amount of data included in the objects that were to be combined. 



17. A method for processing data objects each representing display data for a 
10 display area and having a data type and a location in the display area, the method 
comprising the steps of: 

receiving the data objects; 

establishing in the display area a plurality of non-overlapping bands; 

dividing any data objects that span more than one band into multiple data 
15 objects that are each located in only one band; 

establishing for each band a display list associated with the band; 

storing the data objects located in a band in the display list associated with 
the band; 

dividing each band into a plurality of non-overlapping non-empty regions each 
20 having a location and a region type derived from the data types of the data objects 
in the region; 

providing a plurality of compression mechanisms and decompression 
mechanisms, where each compression mechanism has an associated 
decompression mechanism; 
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compressing *first band of data objects by selecting one of the compression 
mechamsms for each non-empty region in the first band according to the 
corresponding region type and using the selected compression mechanism to 
compress the data objects in the region, thereby producing compressed data objects; 

5 storing the compressed data objects in a memory; 

compressing and storing the remaining bands in the display area by app.yi ng 
to them the preceding two steps, respectively; 

decompressing each band of compressed data objects by selecting for each 
compressed data object a decompression mechanism associated with the 
u compression mechanism used to create the compressed data object and 
decompressing it to produce an uncompressed data object; and 

monitoring to detect when the memory is becoming full and triggering the 
decompression of previously compressed data objects and the recompression 
thereof to free up space in the memory. 
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18. The method of claim 17 further comprising the steps of: 

sending the uncompressed data objects to an output display; and 

determining where an output scan line intersects the regions of a band such 
that the compressed regions are decompressed when the scan line intersects the 
regions. 



19. The method of claim 17 further comprising the step of: 

sending the uncompressed data objects to an output display; and 

outputting background display data for portions of the page not covered by 
" uncompressed data objects. 
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